Evaluation of Mixed-Initiative Knowledge Base Development Methods and Tools
نویسندگان
چکیده
This paper presents a general framework for the empirical evaluation of mixed-initiative knowledge base development methods and tools. It also illustrates it with a knowledge acquisition experiment performed to validate a mixedinitiative method for acquiring problem solving rules directly from a subject matter expert. The main feature of this framework is that the evaluation is an integral part of system design and prototyping. The framework includes a repertoire of evaluation methods, guidelines for designing experiments based on these methods, and reusable evaluation utilities.
منابع مشابه
Mixed-Initiative Development of Knowledge Bases
Ample experimental evidence shows that manual solutions to the problem of building knowledge bases are highly inefficient, while fully automated, machine learning based, approaches have not yet led to practical solutions. This makes this problem an ideal test bed for developing mixedinitiative methods. In this paper we present such a mixedinitiative approach where a subject matter expert teache...
متن کاملSeven Aspects of Mixed-Initiative Reasoning: An Introduction to the Special Issue on Mixed-Initiative Assistants
Mixed-initiative assistants are agents that interact seamlessly with humans to extend their problem solving capabilities or provide new capabilities. Developing such agents requires the synergistic integration of many areas of AI, including knowledge representation, problem solving and planning, knowledge acquisition and learning, multi-agent systems, discourse theory, and human-computer intera...
متن کاملMixed-Initiative Reasoning for Integrated Domain Modeling, Learning and Problem Solving
The main challenge addressed by this research is the knowledge acquisition bottleneck defined as the difficulty of creating and maintaining a knowledge base that represents a model of the exp ertise domain that exists in the mind of a domain expert. The mixed-initiative approach we are investigating, called Disciple (Tecuci et al. 1999; Boicu et al., 2000), relies on developing a very capable a...
متن کاملEFL Teacher Education in Iran: Does It Promote Trainees’ Pedagogical Content Knowledge?
Teacher education programs can play a principal role in helping prospective teachers to acquire requisite knowledge and skills. Vital to the issue of teacher education is the efficient evaluation of such programs in promoting prospective teachers’ knowledge base. However, the literature contains very few reports of the evaluation of the Iranian EFL preservice teacher education program, which is...
متن کاملEvidence for Informing Health Policy Development in Low- Income Countries (LICS): Perspectives of Policy Actors in Uganda
Background Although there is a general agreement on the benefits of evidence informed health policy development given resource constraints especially in Low-Income Countries (LICs), the definition of what evidence is, and what evidence is suitable to guide decision-making is still unclear. Our study is contributing to filling this knowledge gap. We aimed to explore health policy actors’ views r...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2001